Papers with hierarchical method
ART: Adaptive Reasoning Trees for Explainable Claim Verification (2026.findings-eacl)
Copied to clipboard
Sahil Wadhwa, Himanshu Kumar, Guanqun Yang, Abbaas Alif Mohamed Nishar, Pranab Mohanty, Swapnil Shinde, Yue Wu
| Challenge: | Large Language Models (LLMs) are powerful candidates for complex decision-making, leveraging vast encoded knowledge and remarkable zero-shot abilities. |
| Approach: | They propose a hierarchical method for claim verification that uses a root claim and a pairwise tournament of its children to determine an argument's strength. |
| Outcome: | The proposed method outperforms baseline methods on multiple datasets and shows that it is more reliable and clearer than existing methods. |
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences (2021.acl-long)
Copied to clipboard
| Challenge: | Existing hierarchical methods to compute attention are superior to sub-quadratic ones . a particular type of attention, called multi-head scaled dot-product attention, is one of the main components of the Transformer architecture . |
| Approach: | They propose a hierarchical method to compute attention in the Transformer architecture . they perform extensive experiments to show that it captures hierarchic structure in sequences . |
| Outcome: | The proposed method outperforms sub-quadratic models on the Long Range Arena benchmark by over +6 points on average. |